An Overview of the 4th Question Answering Challenge (QAC-4) at NTCIR Workshop 6
نویسندگان
چکیده
In QAC-4, we defined question answering task using any type of question, mainly focused on non-factoid questions. There are 8 participants and 14 runs from these participants. In the evaluation, four kinds of criterion were used for some portion of participants answer set. The evaluation results showed some of the participant systems could focus on the area which correct answer contents exist but have tendency to fail to extract correct answer areas. It is caused by complex question types and difficulty of correct answer scope extraction.
منابع مشابه
Question Answering Challenge for Information Access Dialogue - Overview of NTCIR4 QAC2 Subtask
We describe an overview of Question Answering Challenge (QAC) 2 Subtask 3, a novel challenge for evaluating open-domain question answering technologies, at the NTCIR Workshop 4. In QAC2 Subtask 3, question answering systems are supposed to be used interactively to answer a series of related questions, whereas in the conventional setting, systems answer isolated questions one by one. Such an int...
متن کاملAn Overview of Question and Answering Challenge (QAC) of the Next NTCIR Workshop
In this paper we will propose the question and answering task, called Question and Answering Challenge (QAC), and its first evaluation. This will be carried out as a sub-task of NTCIR3 Workshop scheduled in October 2002. In QAC, we aimed to encourage the development of practical Q&A systems in a general domain and focus on research of user interaction and information extraction. User interactio...
متن کاملQuestion Answering System Using Concept-Based Vector Space Model
This paper presents the architecture of the Concept-based Vector Space Model Question Answering System (CBVSM-QAS) developed at the Nagaoka University of Technology (NUT) and used in the 4-th NTCIR workshop Question Answering Challenge (QAC) evaluation. The CBVSM-QAS runs on the factual question, which is, correspond to the subtask-1 in the NTCIR-4’s QAC. One major peculiarity of this system is...
متن کاملQuestion Answering Challenge (QAC-1): An Evaluation of Question Answering Tasks at the NTCIR Workshop 3
In this paper we describe the Question Answering Challenge (QAC), a question answering task, and its first evaluation (QAC1). The project was carried out as a task of the NTCIR Workshop 3 in October 2002. One objective of the QAC was to develop practical QA systems in a general domain by focusing on research relating to user interaction and information extraction. Our second objective was to de...
متن کاملQuestion Answering Challenge (QAC-1): An Evaluation of Question Answering Task at NTCIRWorkshop 3
In this paper we describe a question answering task, called Question Answering Challenge (QAC), and its first evaluation (QAC1). This was carried out as a task of NTCIR Workshop 3 in October 2002. In QAC, we aimed to encourage the development of practical QA systems in a general domain and focus on research of user interaction and information extraction. Developments of evaluation method of que...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007